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ABSTRACT 

The guidance component of Project Career is evaluated 
m thir, report in terms of project personnel, achievement of stated 
objectives, accomplishments, information dissemination, and coi:t 
ef f GCtivenesG. (The goal of the auidance component was to field test 
occupationally validated behavioral objectives in a K-12 jareer 
development program.) Data was gathered from interviews with project, 
onsite^ and subcontracted personnel, questiovinaire surveys, review of 
documents, visitations, consultation with outside experts, and 
product evaluation. Activities conducted by project personnel at 
three pilot school systems are described, providing an overall view 
of project implementation. The report concludes that although the 
guidance component of Project CAfEER was handicapped l)y the lack of 
complet«e data from the parent project with which to iiaplement tha 
guidance ns^ intended by project objectives; it did succeed in 
developing and implemeniiing at all levels, on a limited scale, a 
number of materials and activities relevant to the project and to ^he 
eventual availability of the Project CAEEEE data b^ink. App.-^ndea is a 
list of Project CAREEP/Guidance presentations. (T?) 
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I, GENE RA L ICTRQDUCTION 

PROJECT CAREER (Corputer Assisted Rc-yoarch for Educational 

Relevance) was funded for a three year period corrjvienc ing July 1, 1971, 

and terninatinq June 30, 1974, The priraary nissioa of thii~ Project 

was "to eirtabliGh a career developnent program which will facilitate 

the le.irriinr; of rr.arket able skills;, basic education<jl concepts, 

knowledr;o, and attitudes required in current, ncv; and er.icroiru. 

occupation:: uy students at the eleinentary , iiecondary, post-^-econdary 

1 

ana <idv:ll education levc^U. 

Durin^j th(» first fi-cal year of the Project two a-'ditional 
qrant i^roj-osals v.ere written and funded. PROJECT CAREER/c-U ID A*JCE 
(OEG-0-72-4G: 1) ^.ac fundeci from July 1, 1972, tollovember 1^.^73, 
witfi tht: terrain it ion date for final reporting purposes e>:"^ ' :1 to 
June 30, 1^^7.^. . PROJECI^ CAREER/IiA::DICAPPED (OEG- 0- 72 -5 1 70 ) . also 
fundr :.! fj-o:- July 1, 1972 Jn.ne 3 0, 1974, with an extensm. : or 
nor.e final int*^rrial report writing through Septt?nber, 1974. 

PROJECT CAP^KR/GUIDA!;CE had as its goal, based on tic -.nowlodge 
base (a bel^avioral ob;)ective product) and capabilities of t: i parent 
project (nov. identified as. PROJECT CAREER/DEVELOPMi:OT ) , to "develop, 
test and evaluatt^ a new approach to providing students fror: IcveU^ 
K through post-secor iary with better knowledge about the spcctru^i 
of occupational oppoi ..unit ics that really exist, inf ormat i'::n about 
the educational requ irerient j:^ which relate to them, and ob-jc,'t ive 
data on theii own abilitie:^ and lir:iit at ions in relation to the 

o 
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requirements of occupations of interest.*' 

CAREER/HANDICAPPED also was to draw on the data base developed 
by PROJECT CAREER/DE\'TLOPME!rr and had as its goal, "meeting the 
individual ne?eds of persons with physical, emotional and other 
disabilities, so that they can, insofar as they arc able, have 
educational and occupational oj^port unit ics equal to those of 
students who are not hand icappt^d . " 

Wy\cn NEESI, as the Third Party Evaluator, began the evalu- 
ation in January 19 V3, these three components constituted the 
totality of PROJECT CAREER and each component was dependent on the 
product drvelop::ient lor the accomplishment of its mission in the 
testincj or piloting phase. 

In July 1973, a fourth corrponent was funded as a separate 
qrant under the title PROJECT CAREER/CAN (Career Analysis Network, 
OEG* 73 -29f)'/ ) with funding providincj for a twelve month period t<-^r- 
ninatmy on June 30, 19 M . 'rhc qoal of this project was centered 
on the development of infori-ation and delivery systems which uould 
cut jcrosi. tirade lines and pi:.vide career i.nformation to students 
and "eacher.'s in grades K- 14^^ , Data revealed, however, that no post- 
high 'zchool i;>iloting was irplcr:;onted in any phane of PROJECT CAREER. 
The structure of this additional component was intended to enable 
further drvelopment of ti.e behavioral objective product tc include 
four columns of curricular information and to absorb the ongoing pilot 
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activities that had Leen started under CAREER/GUIDA!JCE and CAREER/ 
DEVELOmErn^ • 

Because the Third Party Evaiuators were r,. 'Sponsible for 
the evaluation of all three cor:poncnts of PROJECT CAREER as well as 
PROJECT CAREER/Ca::, and because each was in sone way dependent on 
tlie core Project, the separately reported Project cornonentc nr.-d 
to be set m this overall context. Some ovr-r lappi-^.q in thcne reports 
is inevitable, but the evalwatorf', have :r»ade an r-ffort to lo'ju::^ the 
final reports cnly on thasc^ asrects of :Iie component beinn treated 
in each re^-ort . 

This rc^port is a sur.Tiative evaluation of PROJECT CAREFR/ 
GUIDAN'CE coven nc; the last eic^htecn month fundin«j period and those 
additional activities that occurred during the six month extension 
of tltv Proj(-ct. The report will describe and evaluate the results 
of the pjiotmq activity of VRCjJLCI CAREER data and related career 
educa.:.ion materials used in elementary classrooms and junior and 
senior hicjh school guidance programs , 
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PROJECT CAREER/GUIDA!;CE was funded from July 1, 19 72 to 
November 30, 1973. The goal of this Iro^ect was to field test 
the PROJECT CAREER product, occupat icnally validated behavioral 
objectives, in a coordinated career development program • 

The procjrar. v;a:.: to stresr: c.irecr awarene^c at the elementary level, 
c.i.K jr c::!j)lorat 1 on at the junior hioh level, and career decision 
na.^ri:' and placement at the -c^nicr hiqh ]evel. Materials and 
activitirr, hased on PROJECT CAREER data, were to be dcveIo]K:d 
for mplemontiii:: thi.s pilot project. 
PER. sr):::;EL 

The majoi-' central st iLT personnel assigned to thin Project 
inclijdc a Project Adminict rat or , Mr. Rocer Ritch, and a Project 
Coordinator, Mr. Gary Mandeli, The responsibility of the latter 
was to coordinate the actual work of the personnel in the LEA * a 
which consistcMii of appro:-: i r;at ely 30 teachers and guidance personnel 
in three school systems. 
PROJECT 

IMPLIlM Er.TATIO^ ; 

While the Project had clearly defined ob j ect ives, and imple- 
mentation remained faithful to the thrust of these objectives, the 
initial failure of the parent project to provide the data to be 
testcxi meant that LEA personnel had to im^provise their own materials. 




There is no doubt that some aclmiaistr at ive changes greatly impacted 
on these delays. Despite sorr.e false starts, confusion and frustration, 
a number of worthwhile and relevant materials and activities were 
finally developed over the life of the Project, Much of thi^. work 
can be effectively integrated into the use of the PROJECT CAREPR 
behavioral ob^octivci^ dcGpite the fact that the pilot was never 
an effective test of the use of there objectives in a career develop- 
ment prog ran. 
fim:)I ! :c;s 

1. Many valuable potentially transportable niaterialij were 
developed at the Junior High and Senior High levels. 

2. Little interface between the classroom skill development 
and the career decision nakinq procer^n was fully c'oveloped. 
This was prinarily due to the lack of data cnal:linq the 
skill developrr.ent part of the pilot to ir^ake a fair test 
with enough students . 

3. Materials and activities were developed that impacted on 
the facilitation of student placement. However, this 
objective was too far ahead of where the Project could 
go in the time it had and with the constraints placed 

on it by lack of data. 

4. Many specific ele-ients in the Project's objectives were 
completed in exemplary f asliion . 



RECOMMEND AT IQllS 

In view of the above findings, the Third Party Evaluator 
recorruTiends the following: 

1. That any further pilot testing of guidance related 
objectives be established on a carefully articulated 
and coordinated K-12 basis within the same school 
system. 

2. That a total, integrated, transportable model be 
developed for utilizing PROJECT CAREER data for career 
awareness and career development programs in school 
systems . 

3. That further attention be given to the development of 
the model of computer i^u- student inventory files, 
integrating cla!:sroom skill development with career 
decision making. 

4. That the Project make a careful review and evaluation of 
all the activities and materials developed during the 
funding period, and identify those that are ready to be 
shared with other school systems, and those that warrant 
further development and implementation as part of a career 
guidance program . 
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coNCLusio:; 

This Project was handicapped by the failure of the parent 
project tc produce enough complete data with which to iniplcirent 
the guidance use intended by the Project objectives. Despite this 
problem, the Pro;)oct did succeed in developin^j and irrplerricnt i nq on 
iLriited scale j nu::.ber oi excellent materials and activitiei: at all 
levels that v/orr^ relevant to PROJECT CAPJ^EP .-nd the eventual availa 
bilitv oi^ t!i.' I'ROTECT CAREFR data bank. 
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III. HISTORICAL HIGHLIGHTS 

At the outset of this historical review, the evaluators would 
like to point out that the Project had two major development phases 
of about 18 months each. The Third Party Evaluator entered the 
Project as the second phase was beginning, at which time many serious 
problems hc:d developed that placed the success of the Project in 
jeopardy. Many of the ensuing difficulties associated with the 
second 18 months of the Project, during which a new Director was in 
charge, were associated with the effort to cope with these earlier 
difficulties. The review that follows provides some of the details 
of these problems, as well as the successful developments that 
resulted from the rotal efforts of all those involved. 

PROJECT CAPvEER/GUIDAN'CE {OEG-0-72-455 1) was funded from 
July 1, 1972 to Novemcer 30. 1973. The lone range goal of this 
Project was "to de-welop 3r*d demonstrate a coordinated set of processes 
by vvhich students throng hc^ut the K-14 spectrum, are provided with 
infcrm^ation about current, new and em.erging occupations; prerequisite 
skills for them: realistic data concerning one's own aptitude and 
accoT.plishments in skills, units of knowledge^ and related concepts; 
and the near-term and long-range opportunities realistically 
available . 

To accomplish this coal, team.s of guidance and instructional 
p<ersonnel were organized m each of three pilot LEA's at the elemen- 
tary, i^^r-ior high school, and senior high school levels. These 

i 3 -^Q, 
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personnel were to be "liaisons between PROJECT CAREER computer 
information, behavioral objectives, and the appropriate adjustment 
processes and procedures necessary to prepare the student for 
successful performance in the xcorld of work.^'6 ^^^^ connection, 

one of the major dovelop.T.ent iteir.s was to be a dynamic student 
inventory procedur- that would identify the level of student develop- 
ment at any point in tine. 

Recognizing that the PROJECT CAREER data were entirely skill 
based for the selected occupations, CAREER/GUIDANCE also conceived 
of the need to ''deal with the attitudinal qualifications and the 

personal attributes of successful job incurri^ents . " ^ And at the 
elementary and riddle school level, it was to be the task of 

CAREER/GUIDa:CCE "to com-ert specific skill analysis and wor ld~of -work 

inforr^tion into studer-t centered career awareness and exploration 

activities 

Cooperating pilot schools were selected for all pilot test 
coirponents of PROJECT CAREER in the Spring of 1972. The pilot 
schools were chosen to represent a large urban system, a srr.all 
suburban syster:, and a regional vocational-technical school systen. 

first r.ajor event of the Project was a su7rjr:er conference 
in July, 1972 . 3y this tir.e, the LEA's had identified personi^el 
and coordinators who were to be involved in the Project and they 
gathered the carpus of a state college for an intensive one week 
orientation to PROJECT CAREER and specif icallv to CAREER/'GUIDA::CE . 
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Since, at this point, the Project did not have any behavioral 

objective data to provide to the LEA's, the general thrust of this 

orientation was to encourage the LEA personnel to *'do their own 

thing" with regard to developing materials and activities related 

to career awareness and career development. The Project was to 

provide sorr:e funds, sorr.e ideas, sorre supervisory support. 

By the early Fall of 1972, however, the pressure was beginning 

to build up within the base Project to speed up the developrr.ent of 

data- A decision was made to try to enlist the LEA personnel in the 

data development process as converters or writers of behavioral 

objectives. This v;as vicv;ed by the LE;/s as a "shift of direction" 
and created some confusion and bad feelings toward the Project. 

Xvhen NEESI began maV.iac its first interviewing contacts wit';: 

LEA personnel in March and April of 1973, the feedback indicated 

considerable dissatisfaction with PROJECT CAREER. Besides the 

confusion as to what w^as expected and what they were free to do on 

their own, there w^as fiscal confusion, delay in pa\Tr.ents to LEA's, 

difficulty in getting equipment and m.aterials approved for purchase, 

and other sim.ilar annoyances. 

Despite these problem,s, hov:ever, the LEA personnel had, in fact, 

proceeded to develop a number of m.aterials and activities at all 

levels that were in general keeping with the thrust of the Project. 

In addition, there 'vvas a growing avrareness in the LEA's of the 

importance of, and need for, career education. Cle ly the Project 

was a stimulus for the developm.ent of activities that would be 

resoonsive to this need. | ^ (P^i 
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In late June, 1973, a second two day conference was held, 

followed by a four week workshop based in the various LEA ' s • By 

this tinie, PROJECT CAREER had generated sorae BO data, sorc.c but not 

all of it, with con^pleted four colurrins. The workshops wore carefully 

structured to enable the accor.plishnent of specific objectives 

desiyned to elicit ty^e output of sorr^e classroom, and guidrinco 

materials specifically developed from the PROJECT CAREER data. 

At the elementary level, these materials were to take the form 

of learning activity packa^pes (LAP's) that could deal with skills, 

concepts, or simply occupational awareness activities. But the 

basis for these plans were to be drawn from the available data 

supplied by PROJE^rT CAREER. 

The junior and senior high school components were to develop 
materials for use in conjunction with Career Inform.ation Centers 
(CIC's) located in the pilot schools. Specifically, thc^c materials 
were designed to provide career exploration opportunities based on 
PROJECT CAREER data. At this level, a second m,ajor ob^jective of 
each LEA was to develop a student inventory file that could be 
processed by the computer. The purpose of this file was to enable 
the student to keep a record of learning progress of the specific 
performance skills deveirped by PROJECT CARREER, Again, the intent 
was to link all these develcpments with the zROZECI CAREER data- 

Following the end of the Summ.er 1973 workshops, the Project 
was to begin winding down A'ith the term.inaticn scheduled for Novem.ber, 
1974, ;rnile in reality the 1973 Sumrner Vorkshop represented the 

li 




last major formal effort mounted by CAREER GUIDANCE, the intent was 
to have the plans of the su.Tjner workshops iirplenented in the 
classroon^.s and the CIC's during the following Fall. The Project 
did have sufficient rr^orr.entum and funds to enable activities to 
continue through tl:e school year to June, 1974. During this period, 
however, there was lir.ited direction and inputs fror. the central 
staff and very lirdted airounts cf additional data were sent to 
the LEn personnel. 
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IV. EVALUATION? DESIGN 

Designing the evaluation procedures for PROJECT CAREER 
involved the developnent of syst'?!T.at ic information gathering pro- 
cedures that would be a useful part of a viable ongoing fornative 
evaluation of what was essentially a research developnent project. 
The Project goals were to develop a product, and to test the 
feasibility of i'^ s use in the school setting. Although there was 
an early implication in the Pro3ect's aims that a final possible 
outcome could take the form of student I'^arning, in reality, the 
Project did not have this as its stated goal, nor did it core close 
to attaininc this as an ultimate outcome. Thus, the outcomie or 
summarive evaluation was primarily limited to a study of the final 
product as it was developed. Part of the evaluation of the product 
would result from the experiences of potential users of the product 
as they tested it out in its early form in the classroom and thjrcugh 
guidance act ivit ies « 

INITIAL STUDY OF 
FROJECI CARZER/GUIDAl^CE 

Since NZESI's Third Party Evaluatioii did not begin until half 

way through the life of the Project, the initial three r.onth period 

was Si -^^nt developing a thorough understanding of all aspects of the 

Project operations and the personnel that were involved. There was 

a need to prioritize information gathering procedures since tim.e 

constraints necessitated the need of optim.um. time for evaluating 

the Project. Consequently, one aspect of the evaluation design was 
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to plan with the Project Director to identify, on a quarterly basis, 

major areas of concern that should receive particular attention from 

the evaluation team. As the evaluatcrs became r.ore familiar with the 

Project operations, however, they curtailed that particular use of 

time and unpltmented evaluation procedures based on their judgment 

as to what needed closer attention at any given point in the Projects 

EVALUATION M.ILESTCWE 
OBvTECTIVES 

Ultimately, a comprehensive evaluation design was developed 

based on the Cape Cod Milestone Objectives. These were largely 

process and product output objectives, but they provided a very 

systerr.atic basis for information gathering • The nature of these 

objectives and the Project itself lent itself, in a great degree, 

to qualitative evaluation* Much of the quantitative outputs were 

in the forrr; of curr.ulative cour.ts . Since the Project was primarily 

developmental in nature, the evaluators strove for a design which 

insured the ~ost system^atic collection of information possible. 

At the same time, it was also necessary to insure that the information 

obtained could be report.-^d in a form that would be most useful for 

positive, cngoir.c decision-making. Som.e of this information gathering 

took the form, of ongoing consultation with members of the Project 

Staff. Eventually, the evaluation team developed a form of interim. 

reporting in which full reports and shorter memos were prepared on 

specific aspects of the Project in order that this inform.ation would 

reach the Project soon enough to be of value. 



As the evaluators began to submit quarterly and interim 

reports, there developed the opportunity for a kind of dialogue to 

take place between the Project and the evaluators in response to 

the tornative rocorrjr.endat ions that were nade in those reports. 

This proceirs, in turn, provided the source of needed follow up 

activities on the part of the evaluators as needed changes and 

modifications were ic'cntified- Inforrration was continually sought 

fron the Project as to whether changes had been made, were intended 

to be made or not, and for documentary evidence that changes had 

taken place. 

INFORIIATION- GATHERING 
TECHXIQCES 

Following is a listing or various information gathering 
techniques employed by the evaluators in im.plem.ent ing the general 
evaluation plan described above • 

!• Interviews with key Project personnel 

2. Interviews with LEA personnel on site 

3. Interviews with sub-contracted personnel (e-g. converters, 
validators, coders ^ etc.) 

4. Structured surveys or questionnaires of certain Project 
personnel 

5. Inspection of docum.ents, both internal, m^nagem^ent documents 
and products and activities produced by the field testing 

6. Consultation with outside experts 

7. Product evaluation following standards established by 
instructional product design experts 

S. On-site obser^'ation of field testing activities, workshops, 
conferences and personnel tra ining sessions . 




SUBMISSION OF 
INFORMATION 

To provide for consistent and systematic feedback of this 
inforniation to the Project, the evaluators submitted the following 
written documents: 

1. Five written evaluation design proposals 

2. Seven quarterly reports 

3. Interim formative evaluation reports on the following 
aspects of PROJECT CAREER: a) two reports on validation? 
b) two reports on four column development; c) one report 
on general product developm.cnt and packaging; d) one 
report on pilot activities; e) one product evaluation 
report 

4. Whenever key Project central staff were inderviewed, 
memos sumrr.arizing the interviews and the understandings 
reached were sent to PROJECT CAREER within one week. 

Some of the cOT.plexity of monitoring all the available 

sources of information about the Project can be appreciated by the 

fact that over the life of the Project there were close of four 

hundred (403) different persons involved in some aspect of the 

Project. Besides the basic full tir.e Project staff based in the 

Randolph. MA headquarters, there was a large group of affiliated 

LEA personnel in over ten different schools, and there were all the 

sub-contracted personnel that performed the tasks of writing 

objectives, validating objectives, coding objectives, and writing 

four columns for the objectives. The evaluation tea.m. made an effort 

to have some contact^ if only through a sur\*ey form., with all of 

these oersonsr 

21 
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V, PROGRAM OBJECTIVES 

In September, 1972, seven major program objectives were 

written for CAREER/GUIDANCE. These objectives were given further 

operational specification at a managejient conference in October, 1972 

on Cape Cod, fror. which emerged the so--called "Cape Cod Milestone 

Objectives." In addition to these basic objectives, the Project 

developed more specific objectives that became available later in 

1973 (the document was undated) . These objectives provided a detailed 

basis for the final summative evaluative information gathering of 

the Third Party E\'aluator. 

STATED PROGRAM 
OBJECT I\^S_ 



marked the beginning of the Project and pro\'ide brief coTxrents on 
the summative status of these objectives. 

1. GI\'EN VALIDATED PERFORT-LANCE OBJECnivT^ IjTRIVED THROUGH AN Al!^ALYSIS 

75-100 SELECTED OCCUPATIONS, PROVIDE TEACHERS AND GUIDANCE STAFF 
COOPERATCG WITH PROJECT CAREER WITH COMPUTER PRI!^rOUTS CCNTTAINING 
PERFORMANCE 0BJECnV3S RELATED TO EACH OF THE OCCUPATIONS U:Z)ER 
AI;ALYSIS as well as skills C0>2«!0N, BETW^E!; AND AMONG OCCUPATIONS. 

This objective was the whole basis of PROJECT CAREER/GUIDAnCE.. 
so far as it concerned the pilot testing of their behavioral objective 
product. Having this information became i--e condition or ^'given" 
for each of the rem.aining objectives. Unfortunately, this objective 
was never iriet early enough or extensively enough to m.eet the conditions 



We shall begin by presenting the seven basic objectives that 



ERIC 



17 




for the remaining Project objectives. Computer printouts for each 
of the PROJECT CAREER BO ' s were never completed. The "commonality 
search" for skills conmcn between and among occupations was never 
carried out and this information was nevec available. Varied numbers 
of BO 's in a few occupations were provided. Some of these BO's 
were corplete with four columns and some were not. For all practical 
purposes, even this limited data vi^s not risde available until 
June, 1973 for the summer workshops, one year after the Project 
began operating . 

The Third Party Evaluators believe that it is important to 
note in the context of the evaluation of this specific component of 
PROJECT CAREER, that the objectives of this Project did not include 
the development of the data on which this Project depended • Never- 
theless, this Project shared staff with the data development aspect 
of PROJECT CAREER- In relation to this objective, it is safe to 
say that the Project was implemented at least one year too soon. 
2. GIVEIm the 75-lDD OCCUPATIONS SELECTED FOR A::AL\:SIS IN ARRANGED 
AND PvEALISTIC OCCUPATIONAL CLUSTERS, ESTABLISH A PROGRAM E; THE 
ELET'IE^TIARY GRADES, K-5 ON A PILOT BASIS ;%rirCH IDEITTIFIES A!vD 
ISIEGPwATED PJELATED A!0 APPROPRIATE INFORMATION, GENERIC SKILLS 
AND CO^hCilPI^ «: 

A pilot prDgrar.; K-5 was established. The personnel in this 
prograrr. received sorie PROJECT CAREER BO's to work with in the surrr:er 
of 1973, one year after the Project was started. Except for the fact: 



that the basic data from which this objective was to be derived 
never became available until late in the Project, our evaltiative 
observations substantiated that the intent of the objective was 
attained. The quality of the pilot programs, cr at least the pilot 
materials and activities t* at w^ere developed, covered a range from 
poor to very good. 

3. GIVEN AN ELEMENTARY GUIDANCE PROGRAM K-6 BASED UPON PROJECT 
CAREER'S ANAL^-SIS OF THE 75-100 OCCUPATION^ DEVELOP MEANINGFUL 
HANDS-ON ACTIVITIES THAT ERING AN ACCURATE PRESENTTAT ION OF THE 
WORUD-OF-WORK INTO THE ELET^IENIARY CLASSROOM • 

This objective was implemented and a variety of "hands-on 
activities" were developed- Other-^'ise. the corments given for 
#2 above apply here. 

4. GXl^EN CAREER AWARENESS yjkTERIALS DE\'ELOPED BY TEACHERS IN THE 
PILOT SCHOOL DISTRICTS, ESTABLISH PROGRAMS IN THE ELEMEOTARY CLASS- 
ROOMS BY' KHICH SUCH MATERIALS ACT DE\^ELOPME:rrAL PROCEDURES MAY" BE 
TRANSPORTED WITHIN ANT) WITHOUT THE PILOT SCHOOL DISTRICTS. 

In the judgment of NEESI's evaluators, the procram.s and 
materials developed in the pilot schools are not at a stage of 
development where they are very transportable. They clearly have 
the potential fcr transportability. However, very little sharing 
among the pilot schools took place d\iring the pilot period. The 
absence of the PROJECT CAPJEER data during the first year of develop- 
ment also meant that the m.aterials were not developed from, a systematic 
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data base but were more random and individual in relation to the 
skills and interests of the teachers who developed the materials 
and programs . 

5. GWEN MEASURABLE SKILL DEVELOPMEOT INFORMATION AND A VARIETY OF 
APPROPRIATE WORLD -OF --WORK MATERIALS, DESIGN A PROCESS AND PROVIDE 
THE SPACE 3Y WHICH TO ACCESS SUCH INFORMATION IN ORDER TO EXPLORE 

A WIDE VARIETY OF CAREER OPPORTUNITIES. 

This objective called for the developnent of Career Information 
Centers. Each pilot school system did develop a CIC. With the help 
of PROJECT CAREER funds, they were able to identify space and 
purchase sore equipment and materials • Development of a process 
for career exploration through these centers was not very advanced 
at the conclusion of the Project. But the r.odel was there and the 
data would be available after the conclusion of the Project. More 
detailed observations on this and others of these objectives will be 
provided in the section on Findings and Reco:?jr.endat ions • 

6. GTJEN ACCESS TO SEl'ERAL K-14 EDUCATIONAL SYSTEMS {PILOT LEA) AS 
WELL AS POTENTTIAL EMPLOYERS WITHIN THE 75~i00 OCCU?ATIO:S L^uDER 
ANALYSIS, DE^.^ZLO? .?ROGP>A!-:S DESIGNED TO FACILITATE ^lACEyjIl^ OF A 
STUDE:;T in an E^TIRY LE\^EL job, an advanced skill DEVTLOPr-lIZ.Tr ?R0GRA>!, 
OR AN APPROPRIATE BACCALAUREATE DEGREE GRANTING INSTITUTION. 
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NEESI's evaluators never received or uncovered any information 
that would substantiate that this objective was ever implemented 
in any pilot school. Because of the development lag noted above, 
there is no reason to expect that placement procedures could have 
been meaningfully developed in the context of this Project. The 
nature of this objective requires that it be implemented more as a 
last stage in the process of a systematic career development program. 
The earlier stages never reached a level of development that would 
have made implementing this objective possib''! during the effective 
life of the Project. Certainly, however, the potential for im.ple-- 
r.enting this objective is still present in the pilot systems without 
the involvement of PROJECT CAREER. 

1 . GIVE^" THE ?RE\'IOUS SIX OBJECTr/ES AND THE IMPLEMENTING ACTIVITIES 
TO EE PERFGRT'lED. DE\*ELOP MECHANISMS FOR CONTHTUOUS MONITORING OF 
PROJECT CAP^ER/GLTDANCE ACTIVITIES ANT) THEIR RELATION TO THE STATED 
OBJRrrn'ES . 

This objective of internal evaluation of the Project was 
never effectively ir.pler.ented . The Idlest one Objectives did provide 
a ircans for nonitorinc the ongoing activities, but there was no 
syster.atic evaluation plan other than that provided by NEESI. 
Because of the initial handicaps from lack of data under which this 
Project labored, ve doubt that the lack of syster'.atic internal 
evaluation had a det ^'i^ental effect. 




In many respects, the documentary materials available from 

the career/guidance pilots having to do with Project objectives, 

deserve commendation. The evaluative activities of the Third 

Party Evaluators often revealed a picture of haphazard confusion at 

the time of data gathering that does not now appear to be true at 

the end of the Project. The major objectives detailed above were 

modified but never significantly altered from the original intent 

of the Project. In the section on Findings and Recommendat ions, we 

shall provide data that bears on some of those modified objectives. 
SUMMARY 

In summary, the Project and the Project Administrator always 
had a clear direction and well understood objectives. There was, 
at times, some failure to always communicate these directions 
clearly and forcefully to the LEA personnel, since CAREER/GUIDANCE 
was hampered from the beginning by the failure to have the promised 
data upon which all the main objectives were predicated. Yet, it 
is a tribute to Mr. Roger Ritch, the CAREER/GUIDANCE Administrator, 
Mr. Vincent Lamo, the PROJECT CAREER Administrator, the Central 
Staff and to the overall clarity of directions and objectives, that 
the LEA personnel finally accomplished as much as they did as well 
as they did. 




VI. ADMINISTRATION AND PERSOITNEL 

The relationship of CAREER/GUIDANCE to the development of 
the basic PROJECT CAREER data, an occupat ionally validated skill 
objective, was reflected in the administrative staffing. Only two 
persons from the PROJECT CAREER Central Staff had designated 
responsibilities for CAREER/GUIDANCE. One of these, the Project 
A:3ministrator ^ was not paid from CAREER/GUIDANCE funds. The other 
was dejiunated .-,r PROJECT CAREER/GUIDANCE Coordinator. All the 
remaining staff for this Project came from the LEA's. 
PERSONNEL 



Mr. Roger Rtich, who joined PROJECT CAREER in August, 1971, 
was designated Project Administrator with SOT/i of his time assi 
to the management of CAREER/GUIDANCE, with special responsibility 
for providing the interface between this Project and PROJECT 
CAREER, the source of the data development. 

Mr. Gary Mandell was hired as the PROJECT CAREER/GUIDANCE 
Coordinator (PCGC) . He had the requisite background of training and 
experience in the field of vocational guidance and teaching that was 
specified for this position. Mr. Mandell left the Project in 
December, 1973, after the official termination date, but before 
Project activity had actually ended. 



project is a difficult evaluative task. All the evaluative infor- 
mation we have bearing on this aspect of the Project is clearly 



STAFFING 



Assessing the administrative operations associated with this 
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subjective in nature. The role of both administrators was compli- 
cated at the outset by the requirement that they devote some of 
their time to data development operations which were not part of the 
commitment of this Project, but upon which the implementation of 
Project objectives was based. 

Personnel Involvement in PROJECT CAREER 

Mr. Ritch was expected to devote 505^ of his time to the 
management of this Project. Over the course of the first half of 
the Project, he probably devoted half or possibly more of his time 
to CAREER/GUIDANCE involvements. But during the last half of the 
Project, and particularly from Septembei; 1973 to the close of the 
Project, he was perhaps not giving more than 10% of his time to 
direct involvement with CAREER/GUIDANCE. These are estimations 
at best, due to the demand on his time from PROJECT CAREER. 

Although not explicitly stated in the original proposal, 
it is implied that the PCGC would be a full time commitment to the 
Project. In any case, this did not turn out to be so in practice. 
While it is very difficult to estimate how much of Mr. Mandell's 
time was devoted strictly to CAREER/GUIDANCE, we do know that for 
at least six months before he left the Project he was heavily 
involved in the data generation process for PROJECT CAREER. 

The lack of any full time attention from a Central Staff 
administrator to the LEA activities that were the key to CAREER/ 
GUIDANCE^ did have a detrimental effect on the relations between 
PROJECT CAREER and the LEA's. 

2 9 

24 

EKLC 




RETROSPECTIVE 
EVIDENCE 

NEESI has a different view of the total effect of these 

problems at the end of the Project than they had during the ongoing 

evaluation. Retrospective evidence, including memos and other 

documents that were never brought to the attention of the evaluators 

at the time, suggest that Mr • Roger Ritch, the Project Administrator, 

always had a clear picture of the Project Objectives and worked very 

hard to communicate those objectives to the LEA's, including efforts 

to modify and adjust objectives to meet the needs and capabilities 

of the various LEA personnel. 

Our conclusions on this aspect of the Project can best be 

summarized in these observations: 

1* A tone of minim.al centralized direction for the LEA*s 
in this Project was established at the outset with the first 
summer conference and continued to be the general theme of PROJECT 
CAREER involvement throughout the Project. This did lead to 
considerable frustration and some confusion on the part of the 
LEA personnel • Through no fault of his own, Mr. Ritch perhaps at 
first became the target for much of this frustration. 

2. One major reason for the above approach to this Project^ 
was that the data on which the activities were to be based was 
never developed until it was too late to be of much significance 
to the lea's. This meant that creativity, innovation, and individual 
ized developments had to be encouraged by PROJI ? CAREER. 



3. There were, however, some restraints placed on tliis ''do 

your own thing" approach and thec'e were gradually spelled out as 

more spo^cific objectives were developed. The doveloprr.ent of these 

specific objectives, later tied directly to the disbursnent of 

funds during the last twelve months of Project activity, was one of 

the major acconplishr^ents of Mr. Ritch, Project Administrator. Unfor- 

tuncatcly, this process sonetirr.es had the effect, from the point of 

view of the LEA's, of their being told to do their own thing, then told 

to pursue certain specific objectives in certain ways, then left 

to do this essentially on thei own, and finally to be denied 
the data (or most of the ^'.ita due to its unavailability) on which 

they were to base ir.uch of thc?ir activity. It is no wonder that the 

lea's carried n.uch resent neat toward PROJECT CAREER and surprising^ 

in the face of this, th.it they accomplished so much so well. 

Our conclusion from this is nzl that the Project was nis- 

mariagccl, but that the tijuiac,- of its introduction into the overall 

ai:ns of PROJECT CAREER, through no fault of the administrators of 

either PROJECl^ CAREER or PROJECT CAREER/GUIDANCE, was so poor as to 

create an almost impossible management problem, from the outset. 

Given this problem, we want to commend Mr. Roger Ritch and, indirectly 

the PROJECT CAREER Project Director, for their overall efforts in 

bringing this Project through as successfully as it was^ and for 

producing the kinds of important materials which were eventually 

produced . 




LEA PER50N^NEL 

Although^ v.ithout the resources of the Project to help fund 
personnel and supply some natcrials, and without the overall direction 
and objectives set by the Project r.anagenent^ t;iere could have been 
no useful outcorr.e:-, the fact ren.ains that v;hat was done in CAREER/ 
GUIDANCE was acconpl ishxd throucjh tha efforts of the Project Adminis- 
trators and the LEA perr :.':itv^ 1 . 

There were thi?;vy (5G} pori3or;s, teachers, and guidance per- 
sonnel, invo Ived in the three LEA ' s . There was s orre st af f turnover 
during tliis perin>d of time, especially tlie departure of two elemen- 
tary tjuidance coordinators, that effectively ended the last year of 
involver.cnt for tl;c> elerentory prograina in Springfield and Milford. 

Similar pro}jleri;3 truncated tho wor': in the Blue Mills Regional 
Vocational-Technical High Scliool, and in tlic RandoJr^ Junior High 
School . 

Acco^npl i Hlir on t s of LEA Personnel 
Despite those failures, CAREER/GUIDANCE programs were 
established with coordinators and st af fs w'orking , over the course 
cf two school years, to establish career awareness, career exploration, 
and career ::kill programs, all leading to improved career decision 
making. As pointed out in a previous section, the impact on actual 
students cannot be measured at this time^ but there was a clear 
impact on the schools and on the staff that were involved in the 
Project . 




In reviev;ing tho LEA Job Description for this Project, 
the cvaluators cor.cluded that they were quite realistic. The 
duties listed were in fact implemented. Furthermore, they v.-ero well 
conceived because the anticipated products were developed in a form 
that was relevant to the ultimate PROJECT CAREER product, ar.d they 
specified a viable contract m advance between the field wor];crs 
and CAREER/GUIDA!JCE. 
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VII . CHARTsCT ERISTICS OF PILOr LEA'S 



Pilot testing for PROJECT CAREER/GUIDANCE was to be carried 
out in three types of school systems to represent an urban, a com- 
prehensive, and a regional vocational-technical system. Selected 
to match these characteristics were the city of Springfield, the 
town of Milford, and the Blue Hills Regional Vocational-Technical 
school system. 
SPRINGFIEIJ) 

Springfield is characterized by its industrial environment 
and has a population ot 164,000, Though Sprirgfield has a sub- 
stantial population of iniddle income families, more than 43/o of the 
families have income^] of less than $6,000. At the time of their 
selection^ the unemployment rate in Springfield was 7.3%. Welfare 
expenditures were almost double the school budget, and 23% of the 
children in the schools came from homes receiving Aid to Dependent 
Children. 

The school system is organized on a K-6, 3-3 plan with 
15,6 70 elementary and 13,600 secondary students housed in 36 
elementary, 7 junior high and four senior high school buildings. 
The high school program is organized around four specialized 
schools in each of the following areas: classical, technical, 
conmercial, and trade. In addition to its speciality, each school 
conducts a limited comprehensive program. 
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The Springfield School System has, for many years, operated 
a strong occupational education program, along traditional lines, 
in their Trade and Technical High Schools. However, in the Classi- 
cal and Commerce High Schools, virtually no occupational preparation 
and/or counseling existed, 
MILFORD 

Milford is an expanding non-urban (or ex-urban) community 
with a population of about 20,000. Growth has come about from 
business relocations spurred by the excellent major roadway 
connections that have been built in recent years. The majority 
of families fall in the lower middle income bracket, with a median 
family income of just under $6,000. 

The Milford school system's enrollment at the tine of 
selr^ction was 3,500 with 1000 students housed in a Senior High 
School that was originally constructed for a maximani population 
of 600. However, in the Fall of 1973, a new, ultra modern high 
schooJ was opened with the intention of providing a strong occu- 
pational education component along with the offerings of a 
comprehensive high school. 

BLUE HILLS 
REGION 

The Blue Hills Region consists of seven feeder tov'ns for 
the regional vocational-technical high school. The intent of the 
Project was to select one feeder school and develop a model K-12 
pilot program, in career development. The feeder school system 
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that was selected was Randolph, a town with characteristics similar 
to Milford. In addition, another suburban feeder system, Braintree, 
was included in the pilot for activities at the elementary and junior 
high school levels* 
STUDEOTS 

There was never any real selection of students to be involved 
in this pilot program, although the intent to select groups of 
students was implied in the original proposal. Instead, the 
students who were involved were essentially those students who were 
in the elementary classrooms of teachers who were selected for 
participation in the Project. At the junior and senior high school 
level, student involvement was an even more random process. Those 
students who were involved in PROJECT CAREER could be said to be 
those students who happened to make use of the Career Information 
Centers. Numbers cannot be pinned down, but it is safe to say that 
across the three LEA's the total number of students brought into 
direct contact with some phase of CAREER/GUIDANCE activity and/or 
materials would be at least 300. 

In assessing the impact of the Project on students, the lack 
of any clearly ..lelxTied group of students with whom activities were 
to be tested in some systematic way was detrimental to the pilot 
program. On the other hand, there were isolated instances where 
limited and controlled evaluations were made to measure the effective- 
ness of Project related materials. 
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At the high school leve]^ there was an explicit intent to 
relate the piloting of guidance materials to the piloting of 
classroom inntruct ional materials that were to be tested as another 
component of PROJECT CAREER. Scheduling problcims prevented the 
systematic identification of a single group of experimental students, 
however^ so that this group of students could not be systematically 
cycled through the guidance component either. 

In summary, we can say that^ insofar as a direct test of the 
impact of this Project on identifiable groups of students in the 
various LEA*s war- concerned, no meaningful data were ever collected 
by the Project . 



EKLC 



32 



VIII > GENERAL EVALUATIVE FINDINGS 

The objectives of PROJECT CAREER/GUIDANCE essentially 
involved the development of materials, activities, equipment, and 
facility development that would, taken together, serve as a model 
career development program for grades K-12. These outputs were 
intended to be based on the PROJECT CAREER behavioral object ives. 
AS has already been made clear in this report, the basis for the 
career development program was never developed in time to signifi- 
cantly impact the development of activities, materials, etc., so 
that the objectives had to be met in the absence of this data, but 
with the development of this dat^* still in mind. 

These findings can be presented in two general categories. 

First the description of some of the activities and services that 

were developed. Second, the description of facilities, equipment 

and materials. There i^re some obvious overlaps between the two 

areas. Finally, we plan to incorporate these findings in general 

statements of the summative status of PROJECT CAREER/GUIDANCE. 

PROGRAM 
OBJECTIVES 

In order for these findings to be more meaningfully integrated 
into the objectives of the Project, we shall list below for the 
elementary and junior-^senior high components separately, the specific 
objectives that led to the activities, etc., which were evaluated 
as of the conclusion of the Project. 




Elementary Career Awareness Objectives 

1. Establish the means for identifying and integrating 
appropriate occupational information, generic skills, 
knowledqes, and concepts basic to a wide range of clustered 
occupations, into the elementary grades. 

2* Develop hands-on activities that bring an accurate 

representation of the v/orld of work irito the classroom 

through role playing, field trips, community resource 

people, and related subject matter* 
3. Establish transportable models for the utilization and 

exploration by all teachers of the newly developed career 

awareness mater ia Is . 
4* Encouracjo the student to evaluate self in relation to the 

world of work at large, his community and his own developing 

interests, attitudes and skills. 

Objectives for Junior-Senior High School 
Career Exploration and Skill Development 

Coordinate measurable skill development information in a 

wide variety of clustered occupations for student, counselor, 

parent and teacher usage ♦ 

2. Establish computer-assisted Career Information Centers* 

3. Develop diagrams, maps and graphs of representative 
occupat ions showing minimum instruct ional competency 
levels and related occupational options. 




4. Develop hands-on materials designed to assist career 
planning and decision making, such as performance objective 
outlines, that allow a student to manually plan and visually 
explore the instructional programs of choice from a broad 
area of instructional career options. 

5. Design materials to facilitate the placement of on exiting 
student in an entry level job, an ad^'anced skill development 
program, or an appropriate baccalaureate degree granting 
institution, 

6. Encourage the student to evaluate self in relation to the 
world of work at large, his contnunity and lis own ^.jveloping 
interests, attitudes and skills. 

As is perhaps obvious, the implerrontat j on ot very few, if any 

of these objectives, requires 1..g PROJECT CAREER data bank* On the 

other hand, the availability of that data bank would clearly 

enhance the attainment of the objectives, and tie the process into a 

more systematic base. Inevitably, the results of this pilot effort 

Can be seen to be rather fracnented and piecemeal even though the 

individual quality of much of the output was excellent. 

ELEMENTARY CAREER 
A^^ ARENESS ACTIVITIES 

The majority of the accomplishments to be described below 

resulted from the 1973 Summer Workshop, and further development 

during the 1973-74 school year. The following products are not a 

detailed listing of all activities and services performed, b.it 
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but rather are a selection of the more exemplary illustrations 



which could serve as transportable models. 

Blue Hills District 
Braintree and Randolph 

• CARD GAME - a device to develop occupational titles 
from common vocabulary which can be integrated into 
a teaching unit on suffixes and piloted in Grade 4. 
Evaluated to be appropriate for instruction with 
students of at least average reading level. 

• WALL HANGINGS - demonstrates a unit relating drawing 

to scale measurements developed from five LAPs generated 
from a carpentry BO. This was piloted in Grade 4 and 
expanded cognitive math concepts into the psychomotor 
domain. 

• LETTER WRITING a complete individualized programmed 
instruction package including pre-post tests for Grade 
4 teaching in the language arts area, the concepts of 
headings, sentence structure, paragraph structure and 
punctuation. The unit is related to the Business 
Cluster and illustrates specific skills for Clerk 
Typist, etc. A very impressive and professionally 
designed product. 

• FRACTION BOARD - demonstrates the use of wrenches and 
fractions. The concept covered the conrnonality with 
whole numbers; and materials illustrated the relation 
of the concept to store clerics, etc. 

• OCCUPATIONAL AWARENESS IVITH THE TELEPHONE DIRECTORY - 
a unit demonstrating, through pre- post testing and 
employing 15 minutes per day for a month, how to 
increase awareness of occupations located in the 
corninunity . 

• ROLE PLAYHTG ACTIVITIES - an expansion of commercially 
produced materials to include coverage of career aware- 
ness in PROJECT CAREER'S occupations. A sample program 
has been developed for dissemination to the community 
and parents. 

• MAN'S DISCOVERY AND USE C? TOOLS AS PAKT O? A SOCIAL 
STUDIES PROGRAM ON TSCHl^OLOGY - is a hands-on activity 
unit to iuvolx'e children in career awareness. 

4i 
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Springfield 



• CONSTRUCTION - this was a comprehensive unit including 
a model house constructed as a hands-on activity by 
the class. A full set of teacher-made curriculum 
materials was prepared related to constructing the 
model which demonstrates the concepts of vocabulary, 
science and mathematics. 

• CAREER EDUCATION SERIES - a comprehensive set of 
monographs fully equivalent to any commercially 
produced materials that clearly and concisely detail 
What and How To implement various phases of a total 
Career Education Progran. 

#1 Primary Activities 

#2 Intermediate Activities - Elementary Schools 

#3 Audio Visual Aids 

#4 Games for the Classroom 

#5 Field Trips - Elementary Schools 

#6 Language Arts Activities 

Community Index 

Career Awareness with PROJECT CAREER 

General Overall Field Observations Of The 
EleiT^entarv Pilot Program 



The elementary component was a productive program in terms 

of generating ideas and irr.plement ing concepts. Some overall 

findings were as follows: 

I. Career education was not seen as only a supplementary 

aspect of the core curriculum. Rather, the relation of 
career development materials to the curriculum*, served 
to integrate an adequate occupational information 
system directly into every classroom; to relate 
terminal behaviors in a variety of career cluster 
areas to skills learned in the early school years that 
are prerequisite to successful participation in specific 
jobs: and to motivate students by providing validated 
information which responds to such questions as, "t^hy 
am I learning this?" 




2. Career education does not happen accidentally, but 
needs to be meticulously planned and coordinated by 
personnel knowledgeable in the concepts of career 
education. Awareness programs cover a wide range of 
activities and many audiences. Speakers, field visits, 
films and activities must be sequential in terms of a 
student's development, and repetition must be avoided 
within a school system. Evaluation and maintaining 
high quality presentations are essential* Expert know- 
ledge in the full range of materials available to a 
program will contribute to a program's success. 

3. In-service education of staff is extremely crucial. 
The utilization of behavioral objectives requires a 

high degree of sophistication and involves mere knowledge 
and imagination than the ability to produce or convert 
curriculum into BO format. In every case, teaching 
from bo's involved the development of new skills on 
the teachers* parts and definitely affected their 
instructional style . 

4. The usefulness and meaningf ulness of PROJECT C?\REER 
data was judged better when implemented from the four 
colunn inf DriT,at ion. Of the four column ^.he pre- 
requisite learning and concept columns v_ :e found to be 
by far the most valuable. 

JUNIOR HIGH SCHOOL 

CAREER EXPLORATION ACTI\^ITI£S 

Blue Hills District - Braintree and Randolph 
Piloting of PROJECT CAREER'S Ratio and 
Proportion Ob-^ectives 



•This was :i cor.prehensive, well planned^ experimentally 
designed and integrated iir.plementat ion project. It illustrated 
ho*v a guidance counselor recruited and oriented a teacher for a 
piloting exercise. The teacher incorporated a fairly large nurJber 
of PROJECT CAREER BO''s into his regular curriculum. The counselor 
disseminated relevant occupational information in the classroom, 
planned for speakers to visit the classroom, arranged for field 
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visits for the pupils into the cominuniti; and prepared guidelines 
for the teacher both to orient students beforehand and to assist 
students after each visit to examine what they experienced. A 
total assessment program was developed to evaluate cognitive mastery 
and attitudinal reactions to specific program features. The 
experimental vs • control design showed very favorable results for 
PROJECT CAREER materials and this program. Two eighth grade classes 
were involved. 

Randolph 

No materials or progranCs) were observed, nor staff or the 
CIC visited over a two-year period, (Evaluators were in the building 
on different occasions and had requested to interview all staff 
personnel) . A CIC was set up in a corner of the library, 

Milford 

• TEACHER ORIETTATION PACKET - This was a series of 
documents detailing curriculum guides available for 
career development in Middle Schools, Individual 
Learning Units, Audio Visual Resources, and career 
information miaterials housed in the CIC, 

m DECIDING - a locally prepared collection of materials 
to examine eighth graders' interests, self ratings of 
personal characteristics ana a value clarification 
exercise . 

• CO>!XUNITY RESOURCE CARD CATALOGUE • 

Sorincf ield 

m CAREER EDUCATION - The evaluators' opinions of this 

document is that it represents one of the best curriculum 
guides obser\-ed for a career educator. From, the 
Foreward: 
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•'The purpose of this resource guide is to provide 
a general conceptual framework and suggested tech- 
niques and materials for making the junior high 
school curriculum more relevant by providing career 
development experience in all school subjects, as 
well as in general school experiences including 
co-curr icular activities, student grading, student- 
teacher relationships, library activities, and 
school-community activities," 

SENIOR HIGH 
SKILL DE\^ELO?MENT 

Blue Hills District - Blue Hills Regional 

Vocational and Technical School and 
^ Randolph High School 

• STUDEOT INVENTORY FILE - This was an excellent monograph 
which would prove valuable to any career teacher. Topics 
included a Career Resource Description, Student Inter- 
action Model, Counselor's Outline Introducing Students 

to Behavioral Objectives, Student Handbook, Pilot 
Laboratory Instructional Interaction and Evaluative 
Techniques • 

• CAREER CLUSTER CHARTS - Czzeer ladders in Health, 
Structural Wood, Autc.T.otive , Architecture, Business 
and Graphic Arts. 

• A CAREER CACHE KIT (ELECTRONICS) - a model of a dis- 
posable occupational infcrr-atxon system capable of 
disser.inat ing information in smaller units than is 
the t\'pical case, depending upon student interest. 

The Blue Hills Regional Vocational-Technical School was not 

involved with PROJECT CAREER .ring the 1973-1974 school year, 

Milford 

• STlDE^vT FILES - A collection of forrr.s vhich u"ouid be 
helpful to a person who is just establishing a career 
information center (CZC) • 

r CAREER H^FCRT^JJ^TION TORKSHC? - A packet of r^aterials 

which includes a procram outline, sairiple passouts and 
a vorXshoo simulation exercise. 
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• OUTLINE FOR THE STUDY OF AN OCCUPATION This is a 
very detailed step-by-step process for thoroughly 
examining all aspects of an occupation. 

Springfield 

m STUDENT FILE - A folder designed to collect pertinent 
information from existing school records, provision 
for bringing the record up to date and comprehensively 
planned to include interests, aptitudes, abilities and 
career preferences. 

• CAREER PROFILES - CJuick, visual aides to display the 
necessary job requirements for 65 of the PROJECT 
CAREER occupations. 

FACILITIES 

High School 

In two of the L^i'^, Springfield and Milford, the school 
syste"? set aside a rocn to house the CdXeer Information Center 
(CIC) . PROJECT CAREER materials and PROJECT CAREER staff. Both 
of these facilities were very large in size and accomodated 
large group presentations of materials and multiple studer.t 
examination and use of materials. One facility was close to the 
school's Guidance Department, and local PROJECT CAREER staff did have 
an association with the school's counselors. The other facility 
was part of a brand new and exciting multi-m.illicn dollar, multi- 
mediia center, the PROJECT CAREER staff person indicated that no 
coord luxation or cooperation existed between the Center and the 
Guidance Department. The two facilities were considered by the 
evaluatcrs as not being imaginatively organized to stimulate 



independent student use. Cne CIC was considerably better equipped. 




Junior High School 
In Springfield and Milford, two facilities were beinc used 
for housing PROJECTT CAREER materials and PROJECT CAREER staif • In 
comparison to the High School facilities, these two rooms could 
best be described as being of office size and one being of very 
snail physical size. From evidence of longs, these facilities 
were utilized considerably by students. Space limited the use to 
very small groups or individual use. Noting that personnel most 
often make the ditfere.-^ce in a program, the smaller office, through 
a thoughtful display of materials, showed excellent organization 
to promote interest for whomever visited the office. 

Elementary 

No cesicnated physical space was allotted at this level at 
any LEA. 

equip>!e:.^ a^hd 
materials 

^RC-JECI C?xKEER, through its budgetary corxtrols, did not 
permJit, any level, the expenditure of large sum^s of monies on 
equipment. In every LEA, there was a unanimous expression of the 
need fcr more materials than the budget provided. It was noted, 
however, that many materials could be purchased for relatively 
small dolL^r amounts and because these m.aterials could be requi- 
sitioned easier, not requiring any further authorization, this 
represented the easiest part of the budget to m.anage for LEA staffs 
who generally speaking, had little adm^inistrat ive experience. 




Much of the guidance xnaterials examined were those purchased 
through corjnercial suppliers and found in most guidance departments. 
One LEA staff member cor^imif^r I: od that, "There is an over-emphasis on 
production of materials vhf-Clh is very time consuming. There are 
many commercially produced materials around that could meet the sam.e 
objective of exposure to various jobs that people do." The evalu- 
ators concur with this, especially when we consider the training of 
the personnel involved. ERIC documents were also in evidence. 

PROJECT CAREER Workshop Manual - Minimal Requirements of a 
Career Information Center was inspected and found to be a useful 
guida. For some LEA staff it perhaps came too late. Knowing the 
lack of training of some of the LEA staff in this area. PROJECT 
CAREER should have provided earlier assistance for the development 
of resource centers. LEA staff felt the need for greater direction 
in this area, but at the same time were generally proud of their 
materials, for they reflected visible achievements. Also, since 
many m;aterials were collerrted very cheaply or free by the LEA 
staff them.selves, writing letters of request and orcaninir.n: this 
information represented a large investment of their lire. Our 
overall evaluation of the occupatirnal inf orm^at ion in "^he i^source 
centers was that it w*as adequate. LEA's welcomed tne 3?dded availa- 
bility of career materials into thezr schools vhion w^uld not have 
been ther^ if they had not becom.e involved with PROJECT CAREER. 

48 
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Unfortunately, the quality of the early PROJECT CAREER data 
was very poor and LEA staff were dissatisfied with it. When the 
quality was satisfactory, its organization was such that its use- 
fulness was not evident. The materials appeared to look like raw 
data which was net complimentary to the Project. The evaluators 
sensed that if rnoc}. up exemplary samples had been available, they 
would have created a much better impression than what was observed 
in the field, and would have been of much greater instructional 
value - 

Following the very frequently stated assessment, "PROJECT 
CAREER came into the schools too soon. " it va*? not until Spring of 
1974 that PROJECT CP>REER produced s?*mplcs of data that would truly 
comjTiunicate PROJECT CAREER'S contributions to the educational process. 
The m.ost im.pressive piece of data that PROJECT CAREER produced was 
seen for the first time May 16, 1974, by the Third Party Evaluators - 
PROJECT CAREER Cpmcleted Objectives - Auto Mechanics , dated March 4, 
1974. LEA personnel had not seen this document as of early June. 
Two other samples vere: 'PROJUCI d^^ZIiR - A Guidance Product - 
Coding of Friction Concerts '^Conceirts Reouest for Kilford Hich 
School'' and " Ratio and Proportion Concepts for Sraintree Junior 
Hich School" . All three of these documents were judged to be 
excellent vehicles to cor-unicate the value of PROJECT CAREER 
materials to parents, adm.inistra'cors , tl*e business corrr.unity, 
teachers and students. 




IMPACT OF MATERIALS 

ON TEACHERS AND STUDENTS 

Articu'iatioii of the presence of career materials and exposure 

of students to them would have to be considered one of the positive 

values demonstrating PROJECT CAREER/GUIDANCE ' s i.npact on the LEA's. 

But, again, a great deal of variability occurred in each LEA- 

Where figures are cited, they are 1973-1974 statistics- In-service 

education of teachers in the use of PROJECT CAREER materials or 

instruction of students in the use of PROJECT CAREER data could not 

be said to have truly occurred. 

High School 

In Milford, two thirds of tne student population were exposed 
to^the Career Resource Center by either the PROJECT CAREER staffer 
visiting classroor.s or classes of students (10) with their teachers 
visiting the Center where a formal presentation was made. At least 
one teacher in each academic departrrent was instructed infcrmallv 
about the Center. A well prepared publication. Description of 
Milf ore's Caree r Information Center also served a useful function • 
PROJECT CARLER/CI;IDa::CE materials were never seen by Milford 
students . 

In Spr ir^f r.v-^ld ■♦-he log shewed 3&5 persons used the Career 
InforratiDn Ce- .er \-. , ^ a school with a 14C0 student population. 
There was Ii*l le r.-e CIC by teachers and little in the w^ay 

of public relations to -^'-^-late interest in the Center. 
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Junior High School 

In Milford, career information was presented to every eighth 
gradei; and classes were visited by the PROJECT CAREER staff person. 
The CIC director stated she was at a distinct disadvantage in 
disseminating inforncition because no PROJECT CAREER pilot activities 
were conducted xii her school. An in-service educational proaran 
for teachers was conducted. 

In Springfield, tht:re was a very active prograrr. of dissemination 
reflecting obvious coordination with teachers ?,nd adr.inistrarors . 
From Septer.ber to May, 620 students used the CIC, 40 students were 
involved with a Uriiversity of Massachusetts engineering program, 
350 students participated in field trips, 525 students heard class- 
roop. presentations, 200 students visited a vocational school, and 
280 st:udent:s were ir.volved in exploring various ccnrnunity resources. 

Elementary 

Because nost of the eler.entary programs were conducted as 
special or individual projects with single classroom groups, no 
nteanirgful data exists for assessing impact. One of the Braintree 
tear, mem.bers conducted an in-ser^.'ice educational program, for 
teachers but she was hampered in her presentation by the lack of 
PROJECT CAREER data, Springfield im.pacted the entire system, through 
the dissem.inat icn of its Career Education Series to all teachers. 
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GENERAL SUMMARY 
OF FINDINGS 

1. Certain specific transportable materials were developed, 
in the sense that they were materials that could be utilized in a 
career awareness or career exploration program in other places. 

2. The fully developed relationship between the learning 
of skills in the classroom, making of career decisions through the 
use of computerized student files, and the availability of complete 
and 5yHte:nc:t i:!ed TROJECT CAREER data for tying the two together, 
never materialized. The PROJECT CAREER data was never com.plete. 
The pilot operations never had a chance to develop fully enough to 
enable that objective to be met. 

3. Materials and activities were developed that impacted on 
the facilitation of student placement • However, this objective was 
too far ahead of where the Project could go in the time it had and 
with the constraints placed on it by lack of data. 

4. Most cf the specific ele.T>cnts in most of the objectives 
listed at the beginning of this section, were implem^ented to some 
extent in nearly all the pilot schools. The list of the most out- 
standing examples of these aforementioned outputs are representative 
of this attainm.ent. Any one of these e>:ar.ples by itself can represent 
a significant accomplishment of quality and value in a career 

gu id a nc e /c a r e e r d e v e 1 o pm.e nt pr o g r a rn , 

Perhaps one of the m^ajor fai'lure-s of the? Project, one that 
could have been avoided with m.cre foircefu.1 uir^sction from the 



Central Staff, was the lack of any siginficant inter-LEA cooperation 
and coordination. Each LEA functioned essentially independently of 
the others, and there was little, if any, sharing of developnients 
and activities from one LEA to the other, although the central 
staff did try to promote this sharing. This certainly minL^ized 
some of the potential benefits that could have accrued fron 
information sharing, and perhaps also limited the potential trans- 
portability of what was actually developed. 

These findings, of cours^e, are stated in relation to the 
Project objectives. These were ambitious objectives and the 
evaluators do not want to leave the impres.rt.on that the accomplish^ 
r.ents were without significance. We feel that mcst of the descrip- 
tive findings above speak for themselves as evidence of the 
significant and useful accom.plishm.ents in career education for 
the lea's in this cilot oro^ect. 




IX, PROJECT DISSEMINATION 



Froir. August of 1971, to April of 1974, PROJECT CAREER/GUIDANCE 
was active m disseminating information about the Pro3ect. While 
it is true that dissemination, in itself, does not guarantee utili- 
zation of the information, at least it is a step toward greater 
utilization of already learned kricw ledges . Too often the .knowledge 
learned m one Project is never disseminated or transported to another, 



ncnzc its basic 



:iim.inished* 

ortunat e ly , rPvOjrcr Cr^RFER/GlTIDA^^'CE has seized every crpor- 
tunity to dissemmare infcrmaticn. It is hoped that a large num.ber 
of artimlcs v;ill scon ce added to the m.anv and varied >inds of 
dissemination already in effect. The follovnng is a parti ?:! 
listing cf presentations hy TRCJECT CAP^IR/'GVIDiirCE personnel. 
Per a complete liscmg of PRC^EGT CAREE?./GUIDA:;CE rresentat ions , 
see App'Cndix, race A-2 . 



l'?71 - Presentat iozi to Bureau cf Labor 



Au 

Statistics, J.F.K. Building, Boston, MA. - PROJECT 
CAREER a:z: IirTEPJ^ACE ;-,TTH MArCPCV.-ER PROJECTION'S. 

Septemi'Cr 22, 1571 - Educational Testing Service (ETS), 
Princeton, !:ev.- jersy - PROJECT C?,?>JE:I3. a:0 POSSIBILITIES 
FOR A COLLECT IC:: SERVICE CF ^Z^S OK-IM^CE OBJECTIVES . 

November 22 and 24, 1571 - Concord Reformatory, Educati: 
PR.CGRA^-1 



OJE^ 



::e--tcn Public School, !:ewt:on. 
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March 29, 1972 - UniverL^ity of Massachusetts, Waltham 
Field Station - PISTRIBITI'IVE AND EDUCATION CAREER 
DEVELOPMENT PRES 1271 :-,T ION . 

April 7, 1972 - Fri..Tin9h^:iin State Teachers College - 
CONFERENCE ON CAREEii^ n^UCAriON: PROJECT CAREER AS A 
MODEL FOR CAREER DEv^lXOPI^JCNi . 

May 24, 1972 - Hingham Public Schools, Hingham, MA., 
Guidance Department - PRESENTATION ON PROJECT CAPPER 
COMPUTERIZED DATA TO ASSIST GUIDANCE AOT COUNSELING. 

October 31, 1972 - Hopedale Region Guidance Meeting, 
Hopedale, MA. - PROJECT CAREER DATA FOR COUNSELORS. 

April 27, 1973 - M.P.G.A. Career Education Workshop, 
Barry Science Pavillioa, Newton College, Newton, MA. 
IMPLICATIONS OF PROJECT CAREER DATA FOR CAREER COUN- 
SELORS , STiroEMTS , TEACffiRS . 

April 2, 1974 - Bridgewater State Teachers College, 
Bridgewater, MA. - COURSE ON INNOVATIVE PRACTICES IN 
ADMINISTRATION - PRESEOTATION ON PROJECT CAREER 
COMPUTERIZED DATA. 
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X . RECOMMENDAT IONS 

On the assumption that there might be a further extension 
or developir.ent of PROJECT CAREER/GUIDANCE, and in vieA^ oi: the 
findings surrunarized on page 47 , the Third Party Elvaluators 
recomnend the following: 

1. That any further j^jilo': testing of guidance related 
objectives be established cn a carefully articulated and coordinated 
K-12 basis within the same school system. 

2. That a total integrated, transport ab] e model be developed 
for utili7.ing PROJECT CAREER data for career awareness and career 
developricnt programs in scnool systems. 

3. That further attention be given to the development of 
the model of computerized student inventory files, integr.at ing 
classroom skill development with career decision making. 

4. That the Project make a careful review and evaluation of 
all the activities and materials developed during the funding period, 
and identify those that are ready to be shared with other school 
systems, and those that warrant further dc:7elopment and implementation 
as part of a career guidance program. 



1. Vtnaz proportion or rne resources were actually used 
to accon^.plish the objectives? 

2. What v;ore the overall finite costs in relation to the 
obj ect ive.'B accon pl ished (outputs) ? 

3. v;ere there alternative ways to accomplish u.ic objectives 
that would have been rr.ore cost effective'? 

In order for evaluators to provide meaningful answers to 

any of these questions, at least two kinds of information are 

necessary: 

0 A program budget containing dollar amount^j related to 
specific Project object ives . 

• Accurate and cojT;plete fiscal information relating 
d isburcem.ents to objectives as well line items. 

Neither of t}icse conditions was met by any component of PROJECT 

CAREER, with the exception of PROJECT CAREER/CAN which had a program 

budget . 

There v;as an effort made during the last months of the CAREER/ 
3UIDAIXE project to institute budgeting by ob^iectives for expen- 
ditures in each of the pilot LEA ' s . These budgets and related 
objectives were developed by the LEA ' s and submitted to the Project 
administrator for at.>>roval. Disbursements were made based on the 
attainment of or contribution to thv attainment of the local objec- 
tives* However, this constituted only a local arrangement v;ith a 
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rather snull proportion of the total funds expended by PROJECT 
CAREER. Moreover, the records necessary to p.onitor these disburse- 
ments v;ere not surjrarized and would have required a "mini-audit '* of 
requisition forr.L , In any case, the Third Party Evaluators want to 
cor.rnend the Pro:)ect Administrator for this effort at instituting a 
more cost <r»rfective systen* 

Another difficulty with determining cost effectiveness for 
any specific component of PROJECT CAREER is the obvious fact that 
resources wore interdependent such that it v;as impossible to separate 
out the effect of funding from one source from the effect on tlie 
sar:;c obicctive from another source. Central staff personnel seldom had 
single assignments thcX focused 100;' of t)ieir time on one objective 
for one Pro-ject component. Two ey.amples will illustrate this fact. 

The administrator of CAREER/HA^^DICAPPED devoted half or 
more of his t ir.e (variable at different stages of the Project) to 
activities that were related to the data developm.ent objectives of 
CAREER/DEVEL0PME:,T , yet his total salary was funded by CAREER/ 
Ii7v\^DICAPPED. The Curriculum Administrator for PROJECT CAREER was 
paid from CAREER/DEVELOPVEOT funds, yet a major portion of his time 
was devoted to administering and directing the pilot activities 
associated with CAREER/GUIDAXCE , and most of the last year of his 
work on data developrirnt v;as devoted to four column writing v;hich 
was a funded objective under CAREER/CAN. 
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These problems of allocating resources to specific Projects 
with particularized objectives become even more complicated when we 
consider resources going into supplies, equipment rental, adminis- 
trative costs, etc* AS we pointed out, neither the fiscal records 
nor the budgets enabled any meaningful distinctions to be made in 
allocating resources. 



Such data on expenditures as was available to the evaluators 



in surrjT.ary form (apart from actual vouchers and requisitions) con- 
sisted of two categories: 



!• An auditor's report on expenditures for all components 
of PROJECT CAREER from July 1, 1971 through March 19, 
1973 . 

2. Bi-weekly fiscal reports from the accountant for all 
components based on a fiscal 1974 budget. The latest 
of these reports, dated June 18, 1974 formed the basis 
for final figures on Project expenditures. 

We reported elsewhere on the fiscal management difficulties 



that beset the Project during its first two years. The auditor's 
report, dated June 22, 1973, contains the following statement: 
"At the Project office, internal cortrol of expenditures, proper 
classification of charges, comir.unicat ion of financial data to 
Regional School business office, and audit trail of financial 
transactions to the accounting records was inadequate in many 
respects. These deficiencies are noted below through recommen- 
dations for improvement of the accounting system." 



The improv*-.rents were implemented by late April, 1973, but 



there was still a lack of budgeting and disbursement by objectives 
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and over $600,000 had already been spent. Thus, tracing the effect 
of noney spent durin^j the first two fiscal years of PROJECT CAREER 
becarTiO .ilrost irpocsible. An i 1 li.:st rat i on of this problem can 
be r:.:idc for CAIUIER/GUIDANXE . 

According to the June 19 73 auditor's report, $112,003 \vas 
expended fro::; the CAREER/GUIDA::ce z^udgct through March 10, 1973. 
nov;ever, v;hon tlie nev; line iton Ir^udget for fi.scal 1974 vas drav;n up 
and bi. 'Weekly reports be-gun, the CAREER/GUIDAr:CE budget wao' dr.r.vn 
on the basis of the total funding for this Pro;ject frori its incep- 
tion m July, 1^:'^72. Expenditure:; fro:r. the r^onths preceding li::cc)l 
1974 were re ,] 1 locut cd . apparently, to tahe account of tlie fact that 
this hud(.;i.t hnd been tapped for funds needed by other comp-on< nt i- , 
but ',;hich !iad not been avuilablo to PROJECT CAREER when expenditures 
were due. Thus, tlie audit sho\.'i: alirost $uG,OUO expended for per- 
sonnel at the Central L'taff level, but the final CAREER/gUIDa::CE 
budget accounts for only $34,000 to Central Staff personnel. 
Thus, any spending prior to the last fiscal year of this Project 
cannot be accurately accounted for in relation to progress on 
attaining the objectives of this Project. 

In the opinion of the Tliird Party Evaluators, the funding 
agencies are as i-uch to blarre for this state of affairs as is the 
Project administration. Eor sOiTe reason, the funding agencies did 
not insist on a progran budget at the tine the proposals were p.ade 
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or as a condition for the release of funds. (The exception to this 
was IROJECr CARr:ER/CAN) . 

This loaves only the possibility of the nost gross cstir^ates 
of corst ef f ect ivcnciis . For this purpose we have cor^.bined inforr^ation 
on expend It ur OS for all components of PROJECT CAREER into one 
chart, rirjuro 1 . v.'o have, in turn, lunped all objectives into tv;o 
categories, 1) data dove loprnent and 2) pilot activity. v;e have 
furt}u:»r arbitrarily' as£iqnt?d all expenditures for personnel, supplies, 
etc., that were essentially made at the Central Staff level to the 
objective of data dcveloprr.ent . Under data developrr^ent we include 
the co:-{)lction of ci-part objectives (condition, performance, e>rtent, 
prerequisite <r/:iUs, coiiponent tasks, alternative environments, 
concepts, handicapped code) for 116 occupations and all necessary 
corrputer tine, prograr.jning , and output. This arrangement also 
assures that 100/ of the tiire of staff v/as going into data develop-- 
ment, an asuarption that is obVi.ously not true. v;e t --^i; idrrtified 
all the funds that v;ere expended directly to or for LEA personnel 
and their tr a%'el expenses. This money we assumed represented the 
contribution of resources to the pilot activity. This assumption 
is also not true since a portion of supplies, equipment, rental, 
administrative costs, etc. can certainly be assigned to piloting. 
In the absence of any other basis for sorting out these costs, 
hov;ever, we iiavr made this gross allocation. 
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AS can be seen from the chart, the bulk of funding for data 

developrr.ent came from PROJECT CAREER/DEVELOPKENT and PROJECT CAREER/ 

CAN. Major funding for piloting cane fron PROJECT CAREER/HANDICAPPED 

and PROJECT CAREER/GUIDANCE. Of the total $1,123,452 expended by 

the Project through June 18, 1974, nearly $923,000 went to data 

development cind a little more than $200,000 went to piloting. 

COST EFFECTIVENESS 
Q UESTIONS 

What proportion of PROJECT CARFER resources were used to 
accomplish the objectives of all Project components ? In studying 
all the reports on expended funds that were available to us, we 
must conclude that there is no evidence to suggest that any part of 
the resources of this Pro]cct v/ere spent for other than the attain- 
ment of Project objectives. The failure to budget by objective*^ 
makes it impossible to identify v/here or to what extent this 
conclusion m.ight not be true. Tliere is other evidence discussed 
below, however, that indicates not all the pilot test resources 
went into the specific objective of testing the data. 

VThat were the overall finite costs in relation to Project 
a bjec ^ ives or Project output ? We can say from our gross figures 
that it cost over $900,000 to develop a data bank that we estimate 
to be about 90^', complete in the for,n originally proposed when the 
Project was funded in July, 1971. The original funding proposal, 
in which the development of this cata bank was proposed for 
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::oi i le. \. . v i \ .-.ec /oar period, v.dS funded to the extent of 

r'/i . : :?>»uO^OOO had been spent on data development from all 
jvvcvng .'ojic^s by the end of fiscal 1973 (two years into the three 
year funding period) . At that time the data bank inc?.ud d about 
550 completed objecti es. There were also several thouGi.^.d objectives 
at various other stages of the data development systcrr. .Mso at 
this tine the Project was working with the explicit tarc^-^t of 50,000 
objectives in the data bank. In the opinion of the eva]'jators this 
was never a realistic figure and should be essentinl^y discounted 
in looking at the accoinplishment s of the Project and the issue 
of cost effectiveness. But, from the point of view of the stated 
objectives of the Project, the figure was there and certainly created 
an enormous gap between production and target. 

During the last twelve months of the Project, about $150,000 
in new aevolopmcnt money was spent from PROJECT CAREER/CAN. This 
was added to about $200,000 of remaining data development in CAREER/ 
DEVELOPME!rr and another $100,000 drawn from CAREER/IIAND I CAPPED and 
CMREEpyc.UIDANCF. . So, by our gror.s figurc^s, about another ?450,000 
went into d..t^n developHnent daring the last :iscal year of the 
Project. The results w.re the addition of abrut 9,000 more 
completed EC's for the data bank and an additional three to four 
thousand BO'r: in the system needed to complete all 116 occupations. 
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Was PROJECT CAREER cost effective in producing this dat a 
bank of completed beliavioral objectives ? The answer is probably 
"yes and no*' . We can say that the data bank was completed as 
promised in three years and that it cost approximately $923,000 of 
a total budget froir. all sources of $1,400,915 . That is probably 
acceptable for a research and development project breakino new 
curricular territory to develop a product that will be nationally 
transportable witn high potential impact on users and student 
consumers • 

On the otlier hand, the proposal to develop this product 
was funded for $577,875 for a three year period and some of those 
resources had to be used to secure nearly $400,000 more dollars in 
order to com.pl ete the data. It did, in fact, require two years and 
$400,000 to learn hew to produce a product that would have reasonable 
quality and be useful for instruction. A similar amount of money 
($450,000) and one more yec:r, was then required to complete the data 
ban.k for about all 116 occupations on the PROJECT CAREER list. 

For any reasonably definitive answer to the cost effectiveness 
of this Project we must turn to our final question. Were there 
better ways to accomplish the objectives that would have been more 
cost effect ive ? To this question, the evaluators believe the ansv;er 
is a qualified yes , In this context we must look at the second of the 
two major objectives, the pilot testing of the product. 
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Our gross figures indicate that abo. ^200,000 was spent 
over a two year period to pilot test the usefulness of the d^^a. 
Were the data ever pilot tested? The answer to this question is 
essentially .o, Classrooni use of the data was limited to two 
occupational Cj. -ssrooxs using incomplete data for tv/o occupational 
clusters (electronics ar.d business) . No dnta bank with any of the 
corrputer retrieval possibilities was ever available for piloting. 
Data was nevor available in the forn and quantity needed to effectively 
test its use in guidance. Coded data for handicapped populations 
was never available in the quantity and quality needed for an 
adequate test. 

The undcnied accompl islirr.ents of the pilot program in the 
three LEA's and the enthusiasm for the potential of the product 
(the feasibility of which was certainly tested) , cannot obscure 
the fact that the data were never adequately ready for the testing 
that was to take place. We can say, then, that most of the resources 
going into the pilot prograrr^s were not focused on the essential 
objective of testing the usefulness of the product for c i^ance, for 
the secondary classroom, and for handicapped populations. 

This problem, moreover, was extended to the data development 
process. Pilots that had no data had to be kept going on some basis. 
We have no way of knowing, however, to what extent data development 
resources were wasted by the poor timing of the pilot program.s. 




We do know that the funding sources that produced noney for the 
pilot test also added resources available for data developnieni: . 
Were the exigencies oi proposal writing and the requirerrcnts of 
the funding agencies such th.it to get niore noney for data develop- 
ment pilotinc had to be included? The answer to tliis question is 
probably yes. 
SUMMARY 

In closinij, we want to en.ph.isizc that the start up cocts oH 
a project of this magnitude arc bound to be high. In our judcjn.cnt 
the cost55 of this Project v;ere fully warranted in relation to the 
innovations dcvrloped* By concentrating these funds on one project, 
a procer.5 and a product have been developed that can now be duplicated 
by local scliool uysterrs tlirougliout the country at a small frnction 
of these original development costs. 




XII, CONCLUSION 

As wc have previously mentioned, this Project was handicapped 
by the lack of complete data from the parent project with which to 
implement the guidance use intended by the Project orjoctives. 
Despite this problem, however, the Project did succeed in developing 
and ir.plerr.ent inij at all levels, on a limited scale, a number ol 
excellent materials and activities that were relevant to PROJECT 
CAPwIlER and the eventual availability of the PROJECT CAREER data 
bank . 
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PROJECT CAREER/GUIDANCE FOOTNOTES 

1. PROJECT CAREER Comprehensive Project Plan, 
September 1, 1972, page 1 

2. Ibid, pp. 1-2 

3. Ibid, page 2 

4. PROJECT CAREER in Motion Addendum, 
June, 1973 

5. Comprehensive Project Plan, 
Page 46 

6. PROJECT CAREER in Motion 

7. Ibid 

8 . Ibid 
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Project CAREER/Cuidance Presentations 
July 1, 1971 - June 30, 197a 



August 2U, 1971 

Presentation to Bureau of Labor Statistics, J.F.K. Building, Boston, Mass. 

"Project CAREER and Interface with Manpower Projections" 
August 26, 1971 

Evaluation Service Center for Occupational Education (E.S.C.O.E.) 

"Project CAREER and Developing Performance Objectives" 
September 22, 1971 

Educational Testing Service (ETS) , Princeton, New Jersey. 

Presentation on "Project CAREER and Possibilities for a Collection 
Service of Performance Objectives" 

September 23> 1971 

American Institutes for Research, Bedford, Massachusetts. 

Presentation on "Project CAREER and Validation of a Systems Approach 
for Objectives" 

Seotember 2^4, 1971 

Dighton-Rshoboth 

Presentatio-i tc Superirtendert, Vr. Robert Rov. and staff on "Project 
CAPf ER Ccn-.pL!terized Pcta" 
October SO. 1S71 

Massachusetts Personnel and Guidance Associ^ition . 

Workshop o. Career Eujcati.:^ - Benlly College - Braintree 
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November T2, 1971 

Boston Public School System, Department of Special Needs, 

"Needs Analysis Presentation" 

November 22 and 24, 1971 

Concord Reformatory', Educational Division. 

Presenfttion of "Project CAREER as a Model for Inmate Training 
Program" 

November 23, 1971 

Whitman Kiwanis Club, Ridders Country^ Club, Whitman, Massachusetts. 

"Project CAREER as a Curriculum. Model'^ 
December 1, 1971 

Brockton Public Schools, Brockto-, Massachusetts. 

Project C-^ EER presentation 
Decem>ber 2, 1971 

New England Rescurce Center for Occupational Education (N .E .R. CC.E. } 

Project CAREER presentation 
December 1-^, 1971 

Dr. Hershe! Thomas and staff at Massachusetts Department of Corrections 
"Project CAREER as an Institutional Mode!" 
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January 2 1. ^9 72 

Freetown- Lakevi lie Regional Vocational School 

Project CAREER L.E.A Selection Presentation 
January 28, 1972 

Milford Public School, V.ilford, Massachusetts 

Project CAREER - L.E.A. Selection Preseniation 
January 31, 1972 

Newton Public Schoo^ Newton, ^Massachusetts 

Project CAREER - L.E.A Selection Presentation 
February- 1, 1972 

Stoneham Public Schcoi , Stone^ar-, Massachusetts 

Project CAREER - L.E.A Selection Presentation 
Feburarx- 3, 1972 

Springfield Public Schools , Springfield, Massachusetts 

Project CAREER - L.E.A. Selection Presentation 
February 7, 1972 

Brockton Public Schccis , Brockton, Massachusetts 

Project CAREER - L.E.A. Selection Presentation 
February- 16. 1972 

Frami ngh an: V.'r mens' Re-ormaton,' Depa.-trent cf Correction 

Project CAREER Presentatico 
^arch 29, 1972 

University* cr f/assachusetts . Waltharr. Field Station 

Distributive and Education Career DevelcoTient Presentation 
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April 7, 1972 

Framingham Stale Teachers College 

Conference on Career Education: Project CAREER as a Model for 
Career Development 

April 28. 1972 

New Hampshire Vocational Association 

Conference on Career Education: Margate Motcr Inn, Laconia. New 
Hampshire "Project -CAREER Process and Instructional Models" 

May 1972 

Blue Hills Regional VccDticnal-Technical SchocI: State Coordinators for Spi 
Needs 

Project CAREER Presentation 
May 9, 1972 

M.P.C.A. Conference, Amherst, Massachusetts 

Project CAREER Presertaticn 
May 11, 1972 

Division of Curriculum and instruction, C- Max Bcgart, Associate Commis'r 

Project CAREER Process and Ccm.pcnent Project 
May 2^, 1972 

Hinnham Public Schccis, Hingham, Massachusetts. Guidance Department 

Presertaticn on Frcjec: CAREER Corputerired Data to assist Gu.can 
and Ccunseling 
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W5*stern Massachusetts Personnel and Cuidc.r-.e ■ ssociation , Conference on 
Career Education 

Presentation on Project CAREER 

October 31, T972 

Hopcdale Region Guidance \'of tinr , f-opcjale, Massachusetts 

Project CAREER Data for Counselors 
Koverrber 6.. ^972 

Departrnrnt of Labor, \\r , Leon Lguis, Bureau Labor iisilcs, V, asrJ nctr.n , D.C. 

Project CAREER Dat^ 
^N'ove^pber 17, 1972 

Ncrvvalk Publi"c Schc-cls , Nor- a'k, C-^n:er, Dr, Janies Vedved 

Project CA: ; !^:^:^ Prcsentat on 
Anri! 27. 1973 

M,P,G.A. Caret ; Workshcp, Earr\ Scienc Paxi '::on, Neuto-i C:llc^e, 

Newton, V;a5sacn-.:.r:' : 

^'Implica ' T-s i' ' eject CAREER Cat^ fcr C'-eer Ccun :c::or5, S'^jc.'ents, 
Teacher-. 

Ju -e 1973 

Duxbu^V rc---ittee 'or \'-caticna! Ec. cr>. D.:>:bur\', '/assachusetrs 

""Project CAREER Process l C^r-e^ CDveioprr-nt V.cd£--ls'- 
Septer-bo^ 13. 1373 

Lase! e Ju'^iior College, Vu'-s^r £ a^, Nev.to-^. Vsssachjsetts 
'^Project CAREER Cc-rc^teriiec Data'' 
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November 5, 19'^ '^ 

Essex Agricult^r. . School, Hawthorne, Massachusetts, Mr. James Gallant , P:rector 

"Projec- wAREER Con:puterized Data" 
November 6 , V< ' 3 

Soi'tiieast RerMOf^ :! ^'oc^tional-Techn:cal Schcol, Easton, \'assachusetts , 
Mr. Donald Crvv^cc, Director 

'Troj-v^ CAREER '"^orrputer-i -e J Data^' 
NovcT^Lcr 197: 

Sou:Ji Shc-e ^ r;.o 3* V'c : ctiorial-Techn* cal School, Mr. Frederick Tccd, Diroctor, 
Hancvp - . Massc .hi.:- 

"Project C \;--cER CcrrcLiteri rc-d [^uta" 
Noverr ::.- ^r ? 

Nashovr* \ --:'-/ Rccxpa! Vccaiicn^l-'^cchnicdi Scficcl, Mr. Thcn^;as Lafionr-..:: 
Direct . ^ ' . - srrord. M.assach'jsctts 

■■^rc.iect CAREER Ccn^putc-ri zed Data" 
February 5. 19 7-: 

Mi':-^- ^u:::!ic Schcc's, Miltcn, Massachusetts 

"Career Ar.areness Presentati:n'* 
April ^97-^ 

Bridge-vater State Teachers Col.ece, Eridge^vater, '/.assachus etts 

Course on Ir^-^ovative Practices in Ad-rJnistration - Presentation on 
"Project CAREER Ccrrcuterirec Cata" 
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